Quantum Crooks fluctuation theorem and quantum Jarzynski equality in the presence of a reservoir 
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We consider the quantum mechanical generalization of Crooks Fluctuation Theorem and Jarzynski Equality 
for an open quantum system. The explicit expression for microscopic work for an arbitrary prescribed protocol 
is obtained, and the relation between quantum Crooks Fluctuation Theorem, quantum Jarzynski Equality and 
their classical counterparts are clarified. Numerical simulations based on a two-level toy model are used to 
demonstrate the validity of the quantum version of the two theorems beyond linear response theory regime. 
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I. INTRODUCTION: 



Nonequilibrium thermodynamics has been an intriguing re- 
search subject for more than one hundred years |[T]. Yet 
our understanding about nonequilibrium thermodynamic phe- 
nomena, especially about those far-from-equilibrium regime 
(beyond the linear response regime), remains very limited. 
In the past fifteen years, there are several significant break- 
throughs in this field, such as Evans-Searls Fluctuation Theo- 
rem |2|, Jarzynski Equality (JE) |3|, and Crooks Fluctuation 
Theorem (Crooks FT) |4|. These new theorems not only have 
important applications in nanotechnology and biophysics, 
such as extracting equilibrium information from nonequilib- 
rium measurements, but also shed new light on some fun- 
damental problems, such as improving our understanding of 
how the thermodynamic reversibility arise from the underly- 
ing time reversible dynamics. 

Since the seminal work by Jarzynski and Crooks a dozen of 
years ago, the studies of nonequilibrium thermodynamics in 
small system attract numerous attention [5], and the validity 
and universality of these two theorems in classical systems has 
been extensively studied not only by numerical studies [6], but 
also by experimental exploration ||2l in single RNA molecules, 
and for both deterministic and stochastic processes. For quan- 
tum systems, possible quantum extension of Crooks FT and 
JE have also been reported E]. Nevertheless, we notice that 
almost all of these reports about quantum extension of Crooks 
FT focus on isolated quantum systems |9|, and the explicit 
expression of microscopic work, and their distributions in the 
presence of a heat bath are not extensively studied. In addi- 
tion, the relationship between classical and quantum Crooks 
FT is not addressed adequately so far. As a result, the experi- 
mental studies of quantum Crooks FT and JE are not explored 
(an exception is the experimental scheme of quantum JE of 
isolated system based on trapped ions fTOl). 

In this paper, we will give a detailed proof of the validity of 
quantum Crooks FT and quantum JE for an open quantum sys- 
tem based on the explicit expression of microscopic work and 
their corresponding probability distributions for an arbitrary 
prescribed controlling protocol. We also clarify the relation 
between quantum Crooks FT, quantum JE and their classical 
counterparts. In the last part of the paper, the studies based on 
a two-level system are given as an illustration to demonstrate 
our central idea. 




FIG. 1: (Color Online) Trajectories of a quantum system in a 
nonequilibrium process. Similar to Ref. |4| each step (from tn to 
tn+i) is divided into two substeps: the controlling substep of time 
tq, in which the energy spectrum (black solid line) of the system 
change with time, and the relaxation substep of time in which 
the energy spectrum (black dashed line) remains unchanged. In the 
controlling substep (solid line) work is done, but there is no heat 
exchange; While in the relaxation substep, there is heat exchange 
between the system and the heat bath, but there is no work done. 
Blue trajectory corresponds to fast controlling protocol, during which 
there are usually interstate excitations in the controlling substep. Red 
trajectory corresponds to slow (quantum adiabatic) controlling proto- 
col, and the system remains in its instantaneous eigenstate in the con- 
trolling substep. Red trajectory is the counterpart of classical case. 



II. NOTATIONS AND ASSUMPTIONS: 

Crooks FT |4| is firstly derived in classical systems in a mi- 
croscopically reversible Markovian stochastic process. In the 
proof of a classical Crooks FT, a key technique is to separate 
work steps from heat steps. In the following discussion of 
quantum extension of Crooks FT and JE, we will employ the 
same technique as that used in Ref. |4 1 to separate the control- 
ling process into two substeps: controlling substep and relax- 
ation substep (see Fig. 1). The controlling substep proceeds 
so quickly in comparison with the thermalization process of 
the system that we can ignore the influence of the heat bath 
during the controlling substep. So there is only work done in 



2 



the controlling substep. In the relaxation substep, on the other 
hand, there is only heat exchange. 

Having clarified the main strategy (separating work substep 
from heat substep), let us come to the details of the notations 
and assumptions. We employ the same notations and assump- 
tions as that in Ref. H to prove the quantum Crooks FT. In 
Ref [4 1 the author assumes discrete time and discrete phase 
space. Here, the discrete energy spectrum in a quantum sys- 
tem in place of the discrete phase space of a classical system 
arises naturally. We also assume discrete time tg, ti, t2, t^, 
■ ■ ■ , tpf for the quantum system (see Fig. 1). The parameter 
X{t) is controlled according to an arbitrary prescribed proto- 
col \{to) = \a, \{ti) = Ai, A(t2) = As, • • • , \{tN) = As, 
where A and B depict the initial and final points of the pro- 
cess. Every step t„ t„-|_i is seperated into controlling 
substep of time Tq and relaxation substep of time time t]j, 
ti+i = *i + + t|j (see Fig. 1). If we use \in,\m) 
and E{in,Xm) to depict the i,i-th instantaneous eigenstate 
and eigenenergy of the system Hamiltonian H{X„i), we can 
rewrite the trajectory A ^ B of Ref. ||4l in the following way 



|io, Ao> "> \ia, Ai) Ai Ai) ~* \ii, X2) A2 1^2, A2) 
^ ■ • • ^ Kat-i, Ajv-i) Kw-i, Aat) Ajv Un, Aat) . 



(1) 



In the classical case, the system remains in its i„-th state of 
the discrete phase space during the controlling substep. Anal- 
ogously, in quantum systems, this process corresponds to the 
quantum adiabatic regime, i.e., the system remains in its i„- 
th eigenstate of the instantaneous Hamiltonian when we con- 
trol the parameter A(<) of the Hamiltonian H[X{t)] so slowly 
that the quantum adiabatic conditions are satisfied, and the 
above trajectories (1) can be achieved (red trajectory of Fig. 
1). However, if we control the parameter of the Hamiltonian 
very quickly in the controlling substep, and then the quantum 
adiabatic conditions are not satisfied, the trajectory yl ^ _B in 
general should be written as (see blue trajectory of Fig. 1) 



No, Ao) |io, Ai) Ai In, Ai) Ni, A2) A2 1*2, A2) 

— > • • • — ^ \iN-l, Aat) |*Ar-l, Aat) Xn l^N, Ajv) • 



(2) 



The main difference of the above two kinds of trajectories (1) 
and (2) is that after the controlling substep the system may 
not be in the same eigenstate as that before the controlling, 
i.e., in ^ i'n- The internal excitation |i„, A„) A„+i) is 

due to randomness caused by quantum non-adiabatic transi- 
tion and has no classical counterpart. Actually this difference 
of trajectories (1) and (2) highlights the main difference be- 
tween the quantum and classical Crooks FT. For a quantum 
system, the microscopic work done in every controlling sub- 
step is equal to the difference of the energy before and after 
the controlling substep: Wn = E{i'n, A„+i) — -E(i„, A„), and 
the heat exchanged with the heat bath is equal to the difference 
of the energy of the system before and after the relaxation sub- 
step Qn — E{in, Xn) — E{i'n_i, Xn)- For the trajectory (2) as 
a whole, we must make 2N times quantum measurements to 
confirm the microscopic work done and heat exchanged with 
the heat bath. Similar to the classical case, the total work W 



performed on the system, and the total heat Q exchanged with 
the heat bath are given by the summation of work and heat 
in every step, W = J2n=o ^n+i) " ^i'^n, A„)] , Q = 

Y.n=o [Eiin,X„) - A„)], and the total change in 
energy is AE = Q + W = E{iN,XN) - E{in,Xo). Note 
that the work and heat depend on the trajectory, but the en- 
ergy change depends only on the initial and final energy, and 
does not depend on the trajectory. 

Similar to the classical case |4| we assume the trajec- 
tory (2) to be Markovian, and the forward process starts 
from the thermal equilibrium distribution P(|io,Ao)) — 



-f3E{io,\o) 



-/3£;(»,Ao) 



). The joint probability for a 



given trajectory (2) can be expressed as 



N-l 



Pf{A ^ B) =P{\io, Ao)) n Pf{K, A„) ^ KAn+i)) 



n=0 



X Pf(I4,A„+i) ^ |i„+i, A„+i)). 



(3) 



It can be seen that the above probability (3) of a trajectory 
for a quantum case is different from the classical case t4| 
by the extra term P(|i„,A„) — > |iJ^,A„+i)) arising from 
randomness due to quantum non-adiabatic transition. When 
the quantum adiabatic conditions are satisfied, P(|i„, A„) 
\i'n, Xn+i)) = we regain the probability of a trajectory 

in classical systems |4|. We will see later that the quantum 
Crooks FT and quantum JE in the quantum adiabatic regime 
are the counterpart of classical Crooks FT and classical JE. 

To prove the quantum Crooks FT, we also need to con- 
sider the time-reversed trajectory ifTTI of the original trajec- 
tory (2). The time-reversed trajectory corresponding to the 
forward time trajectory A^ B m Eq. (2) can be written as 



e |zo, Ao) ^ e Ai) Aie |n, Ai) ^ e |^'l, A2) A2 

• • • ^ 6 liAT-i, Aat) ^ 6 |i'Ar_i, Aat) XnQ Xn) 



(4) 



where Q |z„, A„) = |i„, A^)* is the microscopic state in the 
time-reversed trajectory lfT2ll . The sequence in which states 
are visited is reversed, as is the order in which A is changed. 
The work done W, the heat exchange Q with the heat bath, the 
change of the internal energy AE, and the change of free en- 
ergy AF for the reversed time direction are the negative value 
of that of the forward time trajectory. The joint probability for 
time reversed trajectory A ^ B can be expressed as 



N-l 



PrIA ^ B) 



xPnie\CXn+i) 

X P{Q\iN,XN)), 



e\l'n,Xn+l)) 
- \hi+l, A,i+l)) 



(5) 



where P(e \iN, Xn)) = g-'^^^'"'^") / J2^ e-'^^^*'^")) is the 
initial thermal distribution for the time-reversed trajectory. 
Also there is en extra term Pr(0 A„) ^ Q \in, A„+i)) 
arising due to the randomness caused by quantum non- 
adiabatic transition in comparison with the classical case. 



3 



ffl. PROOF OF QUANTUM CROOKS FT AND QUANTUM 

JE 

As we have mentioned before, in a trajectory every step 
consists of two substeps, the controlHng substep (not neces- 
sarily to be quantum adiabatic) and the relaxation substep. 
The relaxation substeps are assumed to be microscopically re- 
versible, and therefore obey the detailed balance 1,4, J3J for all 
fixed value of the external control parameter A 











-1, A„) <- 


- e \in, A„)) 



(6) 



To compare the ratio of the probabilities of forward (3) and 
time-reversed (5) trajectories, we also need to know the ratio 
of the probabilities in the controlling substep. In the follow- 
ing we will focus on the study of controlling substep and its 
time reversal. As we mentioned before, during the controlling 
substep, the system can be regarded as an isolated quantum 
system and the evolution is completely determined by a time- 
dependent Hamiltonian H[X{t)]. For example, when the con- 
trolling parameter A is changed from A„ to A„-|_i, the prob- 
ability of the transition from a microscopic state |in,A„) to 
another microscopic state A„+i) can be expressed as 

Ppilin, A„) ^ \C A„+l>) - I iC K+l\U Xn) |' (7) 

where U = Texp{— i J^^ H[\{t)]dt} is the unitary matrix 
describing the evolution of the isolated quantum system in the 
controlling substep, and T is the time-ordered operator Sim- 
ilarly, in the time-reversed trajectory the excitation probabil- 
ity from the microscopic state Q A„+i) to another micro- 
scopic state Q \in, A„) in the time reversed trajectory can be 
expressed as llT4l 



Pi^(e|^„,A„)^e|^;,A„+l>) 



(8) 



= |((*„,A„|e) ec/e (e|z;,A„+i))p, 

where GC/G = Tcxp{-i J*^ H[X{to + h - t)]dt} = 
([/t)* = ijT js time-reversed unitary matrix. Because of 
the property of the time-reversed transformation O |z„, A„) = 
Ihi, An)*, and the property of the Hermitian conjugate matrix, 

( (i„ , A„ I ) * [/^ ( I , A„+i ) ) * = (z; , A„+ 1 1 [/ I z„ , A„) 



it is not difficult to prove that 



1. 



(9) 



(10) 



Based on the above two results (6), (10) and Eqs. (3) and 
(5), we reproduce the Crooks FT for a quantum mechanical 
system 



PpjA ^ B) 
Pr{A ^ B) 



^l3{W-AF) 



(11) 



From Eq. (11) we group all those trajectories with the same 
amount of microscopic work, and obtain 



PF{W\a) 
PRi~W\-a) 



„/3(a-AF) 



(12) 



Eq. (12) is the Crooks FT. Similar to the derivation in Ref. f4l, 
we obtain the JE for a quantum open system straightforwardly 
(6-/31^) = e-^^^ from J PR{~W\^a)da = 1. Here, we 
would like to emphasize that though quantum generalization 
of Crooks FT and JE have been reported in some previous 
work, the explicit consideration of the influence of the heat 
bath, i.e., the explicit expression of microscopic work in the 
presence of a heat bath has not been reported before. Also 
the relation between quantum and classical trajectories are not 
addressed clearly. Hence our quantum mechanical extensions 
of Crooks FT and JE are highly nontrivial. 



IV. 



ILLUSTRATION OF QUANTUM CROOKS FT AND 
QUANTUM JE IN A TWO-LEVEL SYSTEM 



■ N = 5Forward 

- ^ — = 5Backward 
— & — N = lOForward 

- A - AT ^ lOBackward 
— B — — ISForward 

- B - AT - ISBackward 
— e — N ^ 20Forward 

- O -N^ 20Backward 




FIG. 2: (Color Online) Microscopic work distribution Pf{W) of 
forward trajectories (solid lines), and the negative reverse work dis- 
tribution Pr{~W) of their corresponding time-reversed trajectories 
(dashed lines). The probabilities have been normalized. Here we fix 
A{to) and A(fjv). Different distributions represent different control- 
ling time (the more steps, the longer control time). The controlling 
steps are chosen to be A*' = 5 (red •), A'^ = 10 (blue A), A'^ = 15 
(green □), and A*' = 20 (black Q)- h can be seen that the work dis- 
tributions for both forward and reversed trajectories are not Gaussian. 
Moreover, with the decrease of the controlling speed, the fluctuation 
of the distributions decreases, and the difference between the work 
distribution of the forward and time-reversed trajectories becomes 
less obvious. The corresponding forward and negative reverse work 
distribution cross alW — AF, and this is a direct consequence of 
the quantum Crooks FT. The free energy difference AF ia marked 
by the red vertical dash-dotted line. 

Having generalized the Crooks FT and JE to quantum sys- 
tems in the presence of a heat bath. In the following, we 
use the studies based on a two-level system fT5\ as an illus- 
tration to demonstrate our main idea. The Hamiltonian of 
the two-level system is H = A{t) (ct^ + 1) /2, where A{t) 
is the parameter of the Hamiltonian, and CTz is Pauli matrix. 
The initial and final value of the parameter are = A(to) 
and Ab — A(tjv) respectively. The controlling scheme is 
the same as that in Ref. fl5l: We divide the whole pro- 



4 



cess into N even steps. Hence the parameter in the nth 
step is A(i„) = A(to) + nA, n = 1, 2, • • • , iV, where 
A = (A^ — is the change of the parameter in ev- 

ery step. Every step consists of two substeps: the control- 
Hng substep, in which we change the parameter from A(i„) 
to A„+i = A(/;„) + A, and the relaxation substep. For sim- 
pHcity, we consider the case where the system reaches ther- 
mal equilibrium with the heat bath in every relaxation substep. 
Hence, the probability for the forward and reverse relaxation 
substep can be expressed as Fp(|iJi-i, A„) |in, A„)) ~ 



e 



Fi?,(e|z;,_i,A„) ^ 

miMy Also we as- 



sume the quantum adiabatic conditions are satisfied in every 
controlling substep. That is Pp(|i„, A„) |i^,A„+i)) = 
and Pfl(e |«„, A„) ^ e|i;,,A„+i)) = 5^^^^'^. Based 
on these assumptions, the microscopic work distribution for 
the forward trajectories can be obtained 1 15 1 

Pf{WU)^P[ n , . (13) 



g/3(i+l)A _ I 



where 



^ /3[A^ + (j_i)A] 



^,fc = 0,l,2,... ,7V. (14) 



Similarly, the microscopic work distribution for the time- 
reversed trajectory can be expressed as 



^d^r^ p/3Ar /3Ab _ /3(A^+;A)i 



(15) 



where 



P' 



N 



g~/3[AB-0-l)A] 
_^g-/3[AB-0--l)A] ■ 



0,1, 2,... ,7V. (16) 



We plot the above distributions (13) and (14) of microscopic 
work in Fig. 2. Here the probability distribution in the ex- 



cited state are Pe(A^) 



Pe(As) = e- 



/(I 



-PA. 
-PAe 



/(I 



-PA, 



) = 1/3, and 
1/5. The free energy 



difference is AFab = [ln(l + 1/2) - ln(l + 1/4)] ksT w 
0.263 In 2kBT. It can be seen (see Fig. 2) that the correspond- 
ing forward and negative reverse work distributions cross at 
W = AF, no matter what the controlling protocol is, and 
this result is a direct consequence of Crooks FT. It should be 
pointed out that the work distributions (13) and (15) are non- 
Gaussian |15|. Hence, the processes discussed here are be- 
yond the linear response regime. Yet we will see both Crooks 
FT and JE holds. We also plot the logarithm of the ratio of the 
forward and negative reverse work distribution (See Fig. 3(a)). 
It can be seen that all data collapse onto the same straight line. 
In addition, the slope of the line is equal to unit, and the line 
cross the horizontal axis at = 0.263 In 2fcsr = AFab- 
Thus our numerical simulation confirms the validity of quan- 
tum Crooks FT when the process is beyond the linear response 
regime. We also plot the logarithm of the exponent averaged 



work In (e"'^^) and averaged work (W) of the forward pro- 
cess (see Fig. 3(b)) to test the validity of quantum JE. It can 
be seen that the averaged work is greater than the free energy 
difference (W) ^ AF, while the logarithm of the exponent 
averaged work is identical to the difference of the free energy 
In (e"'^^) EE Ai^ sa 0.1823fcBT no matter what the control- 
ling protocol is. Hence, Fig. 3(b) verifies quantum JE when 
the process is beyond the linear response regime. 



V. CONCLUSION AND REMARKS 

In this paper, we explicitly consider the quantum Crooks 
FT and quantum JE in the presence of an external heat bath. 
Our proof includes the proof of classical Crooks FT as a spe- 
cial case. When the quantum adiabatic conditions are satis- 
fied, we reproduce the result of Crooks FT and JE for clas- 
sical systems. Our work indicates that in quantum systems, 
the probabilities (Eqs. (3) and (5)) comes from the quantum 
non-adiabatic transition and statistical mechanical random- 
ness, while in classical system, the randomness only comes 
from the later case. We use the two-level system as an illus- 
tration to demonstrate the validity of quantum Crooks FT and 
quantum JE beyond the linear response regime. 

Before concluding the paper, we would like to mention the 
following points. First, though the quantum non-adiabatic 
transition is introduced into the controlling substep, this sub- 
step is time reversal symmetric. I. e., all the time asymme- 
try is due the relaxation substep (statistical mechanical ran- 
domness), rather than the controlling substep (quantum non- 
adiabatic transition). This is the same as the classical case. 
Second, when we change the Hamiltonian slowly, we repro- 
duce the proof of Crooks for classical systems. In this sense, 
we say that our proof includes the classical Crooks FT and 
classical JE as a special case. Third, for classical system, 
the Crooks FT and JE have been experimentally verified |7|. 
However, for a quantum mechanical system, the experimen- 
tal exploration on Crooks FT and JE has not been reported 
(an exception is I.10J ). This perhaps is mainly due to the 
fact that microscopic work in a quantum mechanical system 
is not a well defined observable fTF|. There is no well defined 
pressure or force for a quantum system 1 17|. Hence, we can- 
not follow the way that we do in classical system to measure 
the force and make the integral of the force by the extension. 
On the contrary, we will have to introduce quantum measure- 
ment processes to confirm the initial and final energy of the 
system and then calculate the microscopic work done from 
the difference of the initial and final energy difference |16|. 
Fourth, though the numerical simulations consider only the 
special cases: 1) the system reach thermal equilibrium with 
the heat bath in every relaxation substep, and 2) the quantum 
adiabatic conditions are satisfied in every controlling substep, 
the quantum Crooks FT and quantum JE are not constrained in 
these special cases. Finally, our numerical simulations based 
on a two-level system can possibly be testified by employing 
Josephson junction charge qubit lfT9]| . Discussion about em- 
ploying Josephson Junction qubit to test the quantum Crooks 
FT and quantum JE will be given later 
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FIG. 3: (Color Online) (a) The logarithm of the probabihties of for- 
ward and time-reversed trajectories as a function of work. It can 
be seen that all data of different work and different control proto- 
cols (N = 5 (red •), iV = 10 (blue A), = 15 (green □), and 
N = 20 (black Q) ) collapse onto the same straight line. The 
slop of the line is equal to unity, and the line cross the horizontal 
axes at = AF. Thus the numerical result verifies the quan- 
tum Crooks FT In [PF(VyU)/Pfl(-W| -a)] = /3{a-AF). (b) 
The averaged work VS. the logarithm of averaged exponent work for 
different control protocols. It can be seen that the averaged work 
(W) (red O) is always greater than the difference of free energy 
AFab and differ from one control protocol to another, while the 
logarithm of the exponentially averaged work In {exTp[— (3W]) (blue 
□) is always equivalent to the difference of free energy irrespective 
of the control protocols. Thus the numerical result verifies the IE 
In {exp[-/3W]) = AF. 
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